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Abstract Psychological need constructs have received 
increased attention within  self-determination theory 
research. Unfortunately, the most widely used need-satis- 
faction measure, the Basic Psychological Needs Scale 
(BPNS; Gagné in Motiv Emot 27:199-223, 2003), has been 
found to be problematic (Johnston and Finney in Contemp 
Educ Psychol 35:280—296, 2010). In the current study, we 
formally describe an alternate measure, the Balanced Mea- 
sure of Psychological Needs (BMPN). We explore the factor 
structure of student responses to both the BPNS and the 
BMPN, followed by an empirical comparison of the BPNS 
to the BMPN as predictors of relevant outcomes. For both 
scales, we tested a model specifying three latent need factors 
(autonomy, competence, and relatedness) and two latent 
method factors (satisfaction and dissatisfaction). By speci- 
fying and comparing a series of nested confirmatory factor 
analytic models, we examine the theoretical structure of the 
need satisfaction variables and produce evidence for con- 
vergent and discriminant validity of the posited constructs. 
The results of our examination suggest that the three need 
variables should not be combined into one general need 
factor and may have separate satisfaction and dissatisfaction 
dimensions. Our model comparisons also suggest the BMPN 
may be an improved instrument for SDT researchers. 
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Introduction 


Psychological.need constructs are enjoying a renaissance 
in contemporary..motivation research, especially within 
the self-determination theory tradition (SDT; Deci and 
Ryan 1985, 1991, 2000; Ryan and Deci 2008; Sheldon 
2004)... According to SDT, psychological needs are 
evolved organismic requirements for certain types of 
experiences, in particular, for autonomy (experiences of 
volition and self-ownership), competence (experiences 
of mastery and effectance), and relatedness (experiences 
of closeness and connectedness with others). Those who 
obtain all three experiences, either as environmental 
affordances or as consequences of self-initiated strivings 
(Sheldon & Elliot, 1999), obtain the “psychological 
nutriments” (Ryan 1995) needed to thrive and grow. 
In contrast, thwarting peoples’ needs undermines their 
happiness, growth, and well-being. 

Empirical research supporting these propositions first 
began to appear in the late 1990s. Sheldon et al. (1996) 
showed that experiences of autonomy and competence 
independently contributed to predicting “good days” (i.e. 
days with more positive mood), via both within-subject and 
between-subject analyses. Reis et al. (2000) generalized 
this finding to include relatedness satisfaction as well. 
Moving beyond mood and well-being, Sheldon et al. 
(2001) showed that all three experiences independently 
predict “most satisfying events,” Sheldon and Bettencourt 
(2002) showed that the three experiences predict group 
belongingness, Filak and Sheldon (2003) showed that all 
three experiences within the classroom predict positive 
evaluations of college teachers, and Smith (2007) that all 
three experiences helped to explain “what’s good about 
good sex.” 
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Measuring need satisfaction 
Domain specific measures 


In the research to date, need-satisfaction has been measured 
in a variety of different ways and contexts. Sheldon et al. 
(1996) and Reis et al. (2000) focused on three daily activities, 
asking participants to rate their felt autonomy, effectance, 
and closeness during those activities. Sheldon and Betten- 
court (2002) use a different set of 9 items to assess need- 
satisfaction within participants’ formal and informal social 
groups. Sheldon et al. (2001) used another set of 9 items to 
assess the need-satisfaction associated with the “most sat- 
isfying events” participants had described. Reeve and 
Sickenius (1994) presented yet a different set of 9 items to 
measure autonomy, competence, and relatedness in school. 
Need-satisfaction scales have also been proposed in the 
specific domains of physical exercise (where there are two 
prominent scales; Wilson et al. 2006; Vlachopoulos and 
Michailidou 2006); the college classroom (Filak and Sheldon 
2003); and in the contexts of relationships (La Guardia et al. 
2000) and work (Baard et al. 2004; Deci et al. 2001). 
Notably, all of the measures described above were 
employed within specific contexts, rather than for “life as a 
whole,” the target of the new scale presented here. Also, 
most of the measures above include only positively-worded 
items; that is, they do not conform to the conventional 
psychometric practice of including reverse-worded items in 
the scale in order to address response and method artifacts. 


Domain general measures 


In the last few years, research has begun to focus on con- 
text-free need-satisfaction, i.e. the extent peoples’ pur- 
ported needs are satisfied in life as a whole. For this task 
researchers are increasingly using a single measure, the 
“Basic Psychological Needs Scale” (BPNS; Gagné 2003), 
modified from a needs scale developed in the work context 
(Baard et al. 2004; Deci et al. 2001). For example, Meyer 
et al. (2007) used the BPNS to-find that fashion models had 
lower total need-satisfaction than controls, explaining their 
lower well-being. Niemiec. et al..(2009) found that new 
graduates pursuing extrinsic goals had reduced well-being 
one year later, as mediated by total need-satisfaction; and 
Kashdan et al. (2006) found that gender interacted with 
trait gratitude to predict autonomy and relatedness need- 
satisfaction. 


Shortcomings of the domain general BPNS 
Although the BPNS has yielded theoretically meaningful 


findings, there appear to be significant problems with the 
scale which may limit its ultimate utility to SDT. 
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Problems with the BPNS items 


First, the BPNS is unbalanced in its subscale items. The 
scale contains 7 autonomy items, 6 competence items, and 
8 relatedness items. Also, the BPNS is unbalanced in its 
positively and negatively worded items. The autonomy 
subscale contains 3 positive and 4 negative items; the 
competence subscale contains 3 positive and 3 negative 
items; and the relatedness subscale contains 5 positive and 
3 negative items. 

In addition to these perhaps minor problems, the BPNS 
also has some questionable items which might address 
multiple needs. For example, the item “people take my 
needs into consideration,” coded™as an autonomy item, 
could almost as easily be assessing relatedness (Johnston 
and Finney 2010), as could the item “people tell me I’m 
good at what I do,” coded as a competence item. Also, the 
item “I feel pressured in mylife” could be indicative of 
missing competence just as well as missing autonomy 
(Johnston and Finney 2010). Additionally, some items are 
ambiguous with respect to the specific need they address. 
“I don’t get much chance to show how capable I am” is 
coded as a missing competence item, but the item actually 
suggests that the person feels quite capable, and is merely 
missing. opportunities to demonstrate this. The items 
“I get along with people” and “people are pretty friendly 
towards me” are coded as relatedness items, but both 
seem more about affiliation than intimacy (McAdams 
1980)—that is, they do not tap a deeper sense of com- 
munion or connection, instead tapping mere pleasant 
social relations. 


Questions about the dimensionality of the BPNS 


Another pressing problem with the BPNS, that reflects 
larger theoretical issues still unresolved in the SDT litera- 
ture, is the dimensionality of the BPNS. Some studies have 
regarded general needs satisfaction as a single construct, 
while other studies have grouped the items into the tradi- 
tional three factors. For example, some researchers treat 
need-satisfaction as a single aggregated construct (Deci 
et al. 2001; Niemiec et al. 2009; Meyer et al. 2007) whereas 
other researchers treat the three needs separately (Filak and 
Sheldon 2003; Reis et al. 2000). Johnston and Finney 
(2010) attempted to fit both a single factor structure and a 
three factor structure to BPNS data. Johnston and Finney’s 
(2010) analyses, conducted on three different datasets, 
showed that a three factor model fit significantly better than 
a one factor model, suggesting needs satisfaction is a mul- 
tidimensional construct. However, the three factor model 
still displayed important evidence of misfit. Their careful 
analysis of the factor loadings suggested a good amount of 
the misfit was due to negatively worded items and also to 
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poorly worded items. Thus, a negatively worded latent 
method factor was added to the model and several poorly 
worded items, many discussed above, were removed. They 
arrived at a cautiously recommended 16 item scale, based 
on a model incorporating three need factors and one method 
factor. 

In line with Johnston and Finney’s (2010) findings, we 
believe it is important to treat needs satisfaction as a 
multidimensional construct because SDT specifies that the 
three needs function separately and combine additively to 
influence outcomes (Deci and Ryan 2000). To combine the 
items into a single, general measure of satisfaction may not 
seem like an egregious act, but this practice risks over- 
looking important distinctive patterns of effects. To use an 
analogy, autonomy, competence, and relatedness are like 
vitamins; people need all three, and particular pathologies 
can result from particular need deficiencies just as scurvy 
result from Vitamin C deficiencies and skin problems result 
from Vitamin D deficiencies. Combining the three sub- 
scales into one thus risks masking such effects. 


Lingering measurement issues with the BPNS 


Although Johnston and Finney’s (2010) final model pro- 
vided a reasonable fit to data, significant problems 
remained. First, the number of items in their final model is 
more unbalanced than the original BPNS, containing only 3 
autonomy items along with 6 competence and 7 relatedness 
items. Indeed, one of the remaining 3 autonomy items was 
said to “not have much utility” (Johnston and Finney 2010, 
p. 289). It can be difficult to obtain good internal consis- 
tency for a scale containing only three items and. also, if 
one item performs badly in a new administration or pop- 
ulation, then researchers have little recourse for finding a 
better performing subset of items. Devillis (2003) suggests 
that including at least four or five items within a subscale is 
best for mitigating against these problems. Second, the 
revised BPNS is also even more unbalanced than the ori- 
ginal BPNS at the level of positive.versus negative item- 
wording: for example, the revised scale contains no nega- 
tively worded autonomy items. Third; even the revised 
model evidenced large unexplained error variance, and 
three of the five negatively worded items were more 
explained by their own method factor than by their corre- 
sponding psychological need factor (Johnston and Finney 
2010, p. 289). 

We believe the complete absence of negatively worded 
autonomy items in Johnston and Finney’s (2010) revised 
BPNS is particularly troubling given some recent devel- 
opments in psychological needs research that suggest 
positive and negative need satisfaction may have differ- 
ential effects on outcome variables. For example, Sheldon 
and Gunz (2009) attempted to show that psychological 


needs function as motives, not just as rewarding and 
perhaps required experiences. They reasoned that if psy- 
chological needs are indeed evolved because of their 
adaptive function for individuals, then people should be 
motivated to go out and obtain missing experiences, rather 
than simply being enervated and passive when needs are 
missing. In three studies, Sheldon and Gunz (2009) 
showed the predicted effects: autonomy, competence, and 
relatedness need-satisfaction negatively predicted motives 
to make life-changes that bring more of the corresponding 
experience. Most importantly for the current article, 
Sheldon and Gunz (2009) showed that it was the nega- 
tively worded items in their 18-item scale that drove this 
effect. In other words, people who-agreed with items such 
as “I feel incompetent” wanted more competence in their 
lives, people who agreed with items such as “I feel 
lonely” wanted more relatedness in their lives, and people 
who agreed with items suchas “I feel controlled” wanted 
more autonomy. In contrast, failing to agree that “I feel 
competent,” “connected,” or “self-determined” did not 
predict wanting more» of the corresponding experience 
when the negatively worded subscales were in the 
equation. 

These results thus suggest that positively and negatively 
worded. need-items are not simply psychometric opposites; 
for some purposes, they may have different substantive 
interpretations and effects. Further supporting this idea, 
Sheldon et al. (201 1a) studied the association of relatedness 
need-satisfaction with the amount of time participants 
spend on Facebook, using the same balanced need-satis- 
faction measure as Sheldon and Gunz (2009). They found, 
first, that greater amounts of Facebook use were positively 
predicted by both relatedness satisfaction and relatedness 
dissatisfaction. In other words, people who use Facebook a 
lot feel both more connected and more disconnected with 
others, a seemingly paradoxical finding. Sheldon et al. 
(2011b) hypothesized that these two associations reflect 
two separate processes: a coping process in which dis- 
connectedness prompts going onto Facebook, and a reward 
process in which Facebook use produces connectedness, 
thereby reinforcing the behavior. Consistent support was 
found for this proposal across Sheldon et al. (201 1b) three 
studies. Thus once again, the positively and negatively 
worded subscales had different effects. Furthermore, Van 
den Broeck et al. (2010) and Bartholomew et al. (2011) 
also found distinctive effects for positively and negatively 
worded items. 


An alternative to the BPNS 
In this article we formally present the 18 item scale 


employed by Sheldon and Gunz (2009) and Sheldon 
et al. (2011b), which we call the Balanced Measure of 


A Springer 


Journal : Large 11031 
Article No. : 9279 


= 
a 


MS Code : 


Dispatch : 28-2-2012 Pages: 13 


LE O0 TYPESET 


(WY cp WY DISK 


215 
216 
217 
218 
219 
220 
221 
222 
223 
224 
225 
226 
227 
228 
229 
230 
231 
232 
233 
234 
235 
236 
237 
238 
239 
240 
241 
242 
243 
244 
245 
246 
247 
248 
249 
250 
251 
252 
253 
254 
255 
256 
257 
258 
259 
260 
261 


262 
263 


264 
265 


266 
267 
268 
269 
270 
271 
272 
273 
274 
275 
276 
277 
278 
279 
280 
281 
282 
283 
284 
285 
286 
287 
288 
289 
290 
291 
292 
293 
294 
295 
296 
297 
298 
299 
300 
301 
302 
303 
304 
305 
306 
307 
308 
309 
310 
311 
312 
313 
314 
315 
316 
317 


Psychological Needs (BMPN). Sheldon and Gunz (2009) 
developed this scale through extensive pilot testing of 
relevant candidate items, prior to using the 18 item version 
in their three reported studies. The scale contains 6 items 
each for autonomy, competence, and relatedness, 3 posi- 
tively worded and 3 negatively worded. In line with Self- 
determination theory, autonomy is defined as the experi- 
ence of volition, choice, and self-regulation; competence is 
defined as the experience of effectance, mastery, and 
ability; and relatedness is defined as the experience of 
support, connection, and closeness with important others 
(Deci and Ryan 2000). Satisfaction is defined as the salient 
presence of the experiences referenced above (“I feel 
competent”), whereas dissatisfaction is defined as the 
salient absence of the experiences (“I feel incompetent”). 
See “Appendix” for the full scale. 

Our first goal was to examine the dimensionality of the 
needs satisfaction scales. In the past both the BPNS and the 
BMPN have been used to measure three separate needs. 
Based on this and upon the theoretical argument that the 
three needs should be treated separately, we modeled 
autonomy, competence, and relatedness as related but 
distinguishable latent constructs (Johnston and Finney 
2010). Again, Johnston and Finney (2010) also found that 
including a negative worded method factor improved fit to 
their data, suggesting that variance associated with nega- 
tively worded items should also be modeled. Also, as noted 
above, Sheldon and colleagues (2009, 2011b) have found 
evidence in multiple studies which suggests that satisfac- 
tion and dissatisfaction function in substantively different 
ways in certain contexts. Taken together, this evidence 
suggests that a multi-trait (autonomy, competence, and 
relatedness) multi-method (satisfaction and dissatisfaction; 
MTMM) approach to analyzing the factor structure of 
needs satisfaction scales may be useful. Thus, in the current 
study, we used the same large sample’s responses to both 
the BMPN and the BPNS to test a factor analytic model 
containing 5 latent variables for both scales: autonomy, 
competence, relatedness, satisfaction, and dissatisfaction. 
We describe the formal logic of our examination of the 
scale in the methods section, below. Based on the prob- 
lematic aspects of the BPNS described above, we hypoth- 
esized that the MTMM model, would fit the BMPN data 
better than the BPNS data. 

Our second goal was to compare the magnitude of the 
correlations from the two instruments to an external vari- 
able, subjective well-being, to determine if either scale 
produced evidence of better predictive power. Again, the 
formal logic of our comparisons is discussed in the method 
section below. We hypothesized that the BMPN data would 
produce more consistent correlations with well-being than 
the BPNS data. 
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Participants 


Participants were 324 undergraduates, 126 men and 198 
women, who were students in a social psychology class at 
the University of Missouri. Participants completed an in- 
class questionnaire in exchange for extra class credit. Five 
participants were excluded from the dataset due to partial 
missing data; these 5 participants did not differ from the 
324 final participants on any of the complete measures. 
Final participants were 88% Caucasian, 6% African 
American, 3% Asian American, and 3% “other.” Because 
no gender effects were detected.in the data, we say no more 
about gender below. 


Measures 


The questionnaire included both the 18 item BMPN and the 
21 item BPNS. The BMPN and BPNS were administered 
with the instructions;»“please read each of the following 
statements carefully, thinking about how true it is for you.” 
A 1 (no agreement) to 3 (some agreement) to 5 (much 
agreement) scale was used. In addition we measured the 
three basic components of subjective well-being (Diener 
1994) using the Positive Affect/Negative Affect schedule 
(Watson et al. 1988) and the Satisfaction with Life Scale 
(Diener et al. 1985). Example positive mood items are 
“excited,” “strong,” and “proud” (alpha = .88); example 
negative mood items are “distressed,” “scared,” and 
“ashamed” (alpha = .90), and example life-satisfaction 
items are “I am satisfied with my life” and “the conditions 
of my life are excellent” (alpha = .86). Positive affect and 
life-satisfaction were correlated r = .34, p < .01; negative 
affect and positive affect were correlated r= — .37, 
p< .0l; and negative affect and life-satisfaction were 
correlated r = — .50, p < .01). As in our past research 
with these constructs (Sheldon and Elliot 1999; Sheldon 
and Bettencourt 2002), we combined these to create a 
single subjective well-being (SWB) composite after 
reverse-coding negative affect. 


Preliminary analyses 


Reliability analyses of the six 3-item BMPN subscales 
found coefficients of .71 and .85 for positively and nega- 
tively worded relatedness, .71 and .70 for positively and 
negatively worded competence, and .69 and .72 for posi- 
tively and negatively worded autonomy. After reverse- 
scoring the negatively worded items, reliabilities for 
BMPN autonomy, competence, and relatedness were .78, 
.79, and .78, respectively. 
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Reliability analyses of the six BPNS subscales (ranging 
from 3 to 5 items) were .83 and .74 for positively and nega- 
tively worded relatedness, .65 and .75 for positively and neg- 
atively worded competence, and .72 and .46 for positively and 
negatively worded autonomy. Obviously, the alpha coefficient 
of .46 for negatively worded autonomy does not meet con- 
ventional standards. After reverse-scoring the negatively 
worded items, reliabilities for BPNS autonomy, competence, 
and relatedness were .68, .75, and .84, respectively. 

We also examined the inter-correlations of autonomy, 
competence, and relatedness, separately for the BMPN and 
the BPNS. The three need inter-correlations were .46, .48, 
and .49 for the BMPN measures, and .59, .64, and .64 for 
the BPNS measures. This suggests that the BPNS contains 
more common variance and less unique variance corre- 
sponding to each need, compared to the BMPN. 


Construct analyses 


Based on Byrne’s (2006) recommendations, we used Con- 
firmatory Factor Analysis (CFA) to examine the construct 
validity of the need satisfaction construct, including three 
need factors and the satisfaction/dissatisfaction method 
factors. Specifically, we used a Multi-Trait Multi-Method 
(MTMM) approach (Campbell and Fiske 1959) to examine 
the extent to which our constructs exhibited evidence of 
convergent and discriminant validity. In so doing we con- 
ducted a series of nested-model comparisons using five 
recommended model structures, separately for the BMPN 
and BPNS data, to produce evidence for the dimensionality 
of the data. EQS 6.1 was used to perform the confirmatory 
factor analyses. See Byrne (2006) for a discussion of the 
basic concepts, applications, and programming for EQS+6.1. 
Below, we present a description of the five models. 


Model comparisons 


A schematic portrayal of the five model structures we 
analyzed is presented in Fig. 1. Model 1, (correlated traits, 
correlated methods) contains five latent factors: the three 
general need factors and the.two method factors. The three 
need factors are construed as the latent “traits,” the satis- 
faction and dissatisfaction factors are construed as different 
“methods” measuring the three needs (in the same way 
that self-report and an observer-report measure might both 
tap anxiety). Model 2 (no traits, correlated methods) was 
the same as Model | except specification of the three latent 
need factors was removed. Model 3 (no methods, corre- 
lated traits) was the same as Model 1, but the satisfaction 
and dissatisfaction latent factor specifications were 
removed. Model 4 (perfectly correlated traits, correlated 
methods) was the same as Model 1, except the covariances 
between the latent needs factors were constrained to 1.0. 


Model 5(correlated traits, uncorrelated methods) was the 
same as Model 1 except the covariance between the sat- 
isfaction and dissatisfaction factors was removed. Model 4 
is not depicted in Fig. 1. 

After computing these models we conducted a taxon- 
omy of nested comparisons on each target scale separately 
to produce evidence for the convergent and divergent 
validity of both the BMPN and BPNS scales. We focused 
our examination of the scales at the matrix level, or on 
comparing the overall fit of the nested models. To compare 
the models, we used the Chi square difference test and 
change in CFI to compare models (Byrne 2006). Signifi- 
cant difference in Chi square between models (p < .01) 
and a change in CFI greater than. .01 (i.e. Cheung and 
Rensvold 2002) were used to determine if two models were 
substantially different. When two nested models that differ 
by two or more parameters are compared, the Chi square 
difference test is essentially.a multivariate test. Accord- 
ingly, we chose a more stringent p value (i.e. .01 as 
opposed to .05) to ensure a rigorous difference test. 

The logic-of the model comparisons was as follows. By 
comparing a modelin which the three self-determination 
theory needs are specified (Model 1) with a model in which 
the three needs are not specified (Model 2), we examine the 
extent to which independent measures of the same needs 
are correlated (i.e., are the relatedness satisfaction and 
relatedness dissatisfaction measures associated by way of 
the latent relatedness need?). Better fit for model 1 estab- 
lishes construct validity for the needs factors by showing 
that corresponding satisfaction and dissatisfaction sub- 
scales converge in measuring their own latent need. 

By comparing a model in which latent satisfaction and 
dissatisfaction factors are specified (Model 1) with a model 
in which these two factors are not specified (Model 3), we 
examine the extent to which independent measures of the 
same methods are correlated (i.e., are the relatedness dis- 
satisfaction, competence dissatisfaction, and autonomy 
dissatisfaction measures associated by way of the latent 
dissatisfaction factor?). Better fit for model 1 establishes 
construct validity for the method factors by showing that 
corresponding need subscales converge in measuring their 
own latent method factor. 

By comparing a model in which the need factors are 
freely correlated (Model 1) to a model in which the needs 
factors are constrained as perfectly correlated (Model 4), 
we examine the extent to which the three needs should be 
differentiated from each other. Better fit for model 1 
indicates the needs factors are not collinear and are tapping 
different constructs (divergent validity). This would also 
suggest that the three needs should be examined separately 
by researchers, not treated as a single aggregate. Finally, by 
comparing a model in which satisfaction and dissatisfac- 
tion factors are freely correlated (Model 1) with a model in 
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Fig. 1 Hypothesized MTMM 
BNS CFA models. First Panel: 
Model 1. Second Panel: Model 
2. Third Panel: Model 3. Fourth 
Panel: Model 5. Model 4 is the 
same as Model 1 with the 
covariances between the three 
needs factors constrained to 1.0. 
R relatedness, C competence, 
A autonomy, S satisfaction, 

D dissatisfaction. Item numbers 
correspond to item numbers in 
the “Appendix” 
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which the satisfaction/dissatisfaction factors are specified 
as uncorrelated (Model 5), we test whether the two mea- 
surement constructs diverge from each other. If models 1 
and 5 fit equally well this would suggest that the different 
methods are unbiased indicators of their latent traits. For 
example, we do not necessarily want the NEO neuroticism 
and NEO extraversion scales to correlate more strongly 
with each other just because they came from the NEO 
(Costa and McCrae 1985), when analyzed in conjunction 
with extraversion and neuroticism scales taken from a 
different inventory. We would want to scales to be sound 
measures of their individual traits, without significant 
shared method variance causing bias in trait measurement. 


Determining model fit 


To assess the fit of the models, we examined common fit 
indices used in CFA. Measurement researchers have argued 
that although it is common for fit indices to be thought of as 
immovable, perhaps a better approach is to use them as 
guidelines with the more rigorous criteria as the upper bound 
and the less rigorous criteria as the lower bound. Hu and 
Bentler (1999) argue for using combinations of cutoff values 
to examine model fit. Kline (2005) echoes this point sug- 
gesting over-emphasis on statistical criteria can be coun- 
terproductive, as do Marsh, Hau, and Wen (2004). 
Accordingly, we examined the ratio of the Chi square sig- 
nificance test and the degrees of freedom, the Standardized 
Root Mean square Residual (SRMR), the Comparative Fit 
Index (CFI), and the Root Mean Square Error of Approxi- 
mation (RMSEA) to assess model fit. To determine good- 
ness of fit, we chose “adequate” cut-off criteria asa starting 
point (Hu and Bentler 1999) and paid close attention to 
whether our results approached or surpassed rigorous cutoffs 
(denoted in parentheses): y*/df < 2.0; CFI >.90°(.96); 
SRMR < .08 (.07); RMSEA < .10 (.06) (Hu and Bentler 
1999). 


Scale comparison 


After examining the BMPN-and the BPNS measures sep- 
arately and examining model comparisons, we followed 


Table 1 Summary of goodness of fit indices for BMPN models 


Kline’s (2005) recommendations for comparing non-nested 
models to determine which might be the better scale. Kline 
suggests that although the values of Chi square from two 
different, non-nested models can be compared, this com- 
parison cannot be interpreted as a test statistic. Thus, 
comparison of the Akaike’s Information Criterion (AIC) 
can be performed to determine the preferred model. 
Between two competing models, the lowest AIC values are 
preferred. Factor loadings from the model that we found to 
be most consistent with the data are presented. 


Results 
Model comparisons for the BMPN. items 
Goodness of fit indices 


Goodness of fit indices were calculated for all five BMPN 
models. See Table | for a summary of results. Results 
indicated that Models»1 and 5 met the rigorous cut-off 
criteria for model fit (Kline 2005; Byrne 2006). 


Construct validity 


See Table.2 for a summary of model comparisons. We 
tested for evidence of convergent validity of the needs by 
comparing model 1 with model 2. The A x was significant 
(77 (21) = 695.18, p < .001) and the difference in practical 
fit(A CFI = .308) was substantial, suggesting independent 
measures of the same need factor are correlated. We tested 
for evidence of convergent validity of the satisfaction and 
dissatisfaction factors by comparing model 1 with model 3. 
The A 7” was significant (y? (19) = 484.08, p < .001) and 
the difference in practical fit (A CFI = .213) was sub- 
stantial, suggesting independent measures of the same 
method factor (satisfaction versus dissatisfaction) are cor- 
related. This suggests that the methods factor needs to be 
modeled in CFA in order to produce adequate fit; focusing 
on only the three needs will not produce adequate fit. 

We tested for evidence of discriminant validity of the 
needs by comparing model 1 with model 4. The A y” was 


Model type Lldf CFI SRMR RMSEA 

Model 1 Correlated traits/correlated methods 1.51 .974 .043 .040 (.027; .051) 
Model 2 No traits, correlated methods 6.46 .666 .102 .130 (.121; .138) 
Model 3 Correlated traits/no methods 4.96 .761 .112 .112 (.102; .119) 
Model 4 Perfectly correlated traits/correlated methods 3.93 .845 .081 .095 (.086; .104) 
Model 5 Correlated traits/uncorrelated methods 1.45 .974 .042 .039 (.026; .051) 
n = 324 
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Table 2 Differential goodness of fit indices for BMPN MTMM 
nested model comparisons 


Model comparisons Difference in 


va df CFI 


Test of convergent validity 
Model 1 versus Model 2 (traits) 
Model 1 versus Model 3 (methods) 
Test of discriminant validity 
Model 1 versus Model 4 (traits) 285.35 3 .129 
Model 1 versus Model 5 (methods) .08 1 .000 


695.18 21 .308 
484.08 19 .213 


significant (7 (3) = 285.35, p < .001) and the difference 
in practical fit (A CFI = .129) was substantial, suggesting 
that the three needs factors should be distinguished from 
each other. 

To test for evidence of discrimination of the methods, 
and also for measurement bias, we compared model 1 with 
model 5. The A ra was not significant Ca (1) = .08, 
p > .90) and the difference in practical fit (A CFI = .002) 
was not substantial, suggesting that evidence for the dis- 
criminant validity of the satisfaction factors was substan- 
tially stronger than for the self determined needs, 
indicating little measurement bias for methods. That is, 
although the two methods factors are related, their shared 
variance does not negatively impact trait measurement. 


Model comparisons for the BPNS items 
Goodness of fit indices 


Goodness of fit indexes were calculated for all five BPNS 
models. As is commonly the case with complicated CFA 
models, model | produced a condition code indicating the 
correlation between autonomy and relatedness was con- 
strained at the upper bound. We imposed an equality 
constraint (Marsh et al. 1992) to set the problematic 
parameter equal to the convariance between autonomy and 
competence. Respecification resolved the presence of the 
condition code. Results indicated that none of the models 
met rigorous cut-off criteria foradequate model fit (Kline 


Table 3 Summary of goodness of fit indices for BPNS models 
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2005; Byrne 2006), though models 1, 4, and 5 met adequate 
standards sometimes described in SEM literature (i.e. Hu 
and Bentler 1999). See Table 3 for a summary of results. 


Construct validity 


See Table 4 for a summary of model comparisons. We 
tested for evidence of convergent validity of the needs by 
comparing model 1 with model 2. The A x was significant 
(7 (23) = 236.819, p < .001) and the difference in prac- 
tical fit (A CFI = .088) was substantial, suggesting inde- 
pendent measures of needs are correlated. We tested for 
evidence of convergent validity of the satisfaction and 
dissatisfaction factors by comparing model 1 with model 3. 
The A x? was significant (y? (21) = 223.89, p < .001) and 
the difference in practical fit (A CFI = .084) was sub- 
stantial, suggesting independent measures of the same 
method factor (satisfaction..versus dissatisfaction) are 
correlated. 

We tested for evidence of discriminant validity of the 
needs by comparing model 1 with model 4. The A 7” was 
significant (x (2). =, 16.23, p < .001) and the difference in 
practical fit (A CFI = .006) was not substantial, providing 
little’ evidence that needs factors should be distinguished 
from each other using data generated from the BPNS. In 
other words, there was no important difference in the 
BPNS data between a model that distinguished between 
needs factors and one that did not. 

To test for evidence of discrimination of the methods, 
and also for measurement bias, we compared model 1 with 
model 5. The change in Chi square could not be calculated 
because the two models possessed the same number of 
degrees of freedom due to model respecification. The 
improved fit of model 5 (A CFI = -.020) was substantial, 
suggesting a lack of discriminant validity and common 
method bias across methods of measurement. 

Finally, we evaluated the 16 item version of the BPNS 
recommended by Johnston and Finney (2010). There was 
essentially no difference in fit between this model and the 
model reported in Table 3: CFI for the 16 item analysis 
was .915 (versus .911 for the 21 item analysis), RMSEA 
was .072 (versus .064), and SRMR was .052 (versus .053). 


Model type Lldf CFI SRMR RMSEA 

Model 1 Correlated traits/correlated methods 2.32 911 .053 .064 (.055; .072) 
Model 2 No traits, correlated methods 3.30 823 .069 .084 (.077; .092) 
Model 3 Correlated traits/no methods 3.26 .827 .068 .084 (.076; .091) 
Model 4 Perfectly correlated traits/correlated methods 2.39 905 051 .066 (.057; .074) 
Model 5 Correlated traits/uncorrelated methods 2.28 931 .053 .063 (.055; .071) 
n = 324 
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Table 4 Differential goodness of fit indices for BPNS nested model 
comparisons 


Model comparisons Difference in 


a df CFI 
Test of convergent validity 
Model 1 versus Model 2 (traits) 236.82 23 088 
Model 1 versus Model 3 (methods) 223.89 21 084 
Test of discriminant validity 
Model 1 versus Model 4 (traits) 16.23 2 .006 
Model 1 versus Model 5 (methods) —6.08 0 —.020 


n = 324 


Therefore, there is no reason to believe that the shortened 
BPNS performs better than the regular BPNS, based on this 
data. 


Comparison of the most consistent BMPM and BPNS 
models 


We compared the two scales using model 5 because for both 


scales it produced the best overall fit and the least amount of 
error. Additionally, it was the most parsimonious and most 


Table 5 Parameter estimates for BMPN Model 5 


consistent with the theoretical structure of the data. The fit 
of model 5 for the BMPN (y7(114, N = 324) = 170.869, 
p < .001, CFI = .974, RMSEA = .039, SRMR = .042) 
was substantially better than the fit for the BPNS model 5 
(x165, N = 324) = 376.663, p< .001, CFI = .913, 
RMSEA = .063, SRMR = .053). Additionally, the BMPN 
AIC for both the independence (AIC = 2,035.588) and the 
hypothesized model (AIC = -57.131) were lower than the 
BPNS AIC for the independence (AIC = 2,226.931) and 
the hypothesized model (AIC = 46.663). Taken together, 
these results suggest the BMPN is the preferred scale. 
Parameter estimates for BMPN model 5 are presented in 
Table 5. 


Well-being analyses 


Psychological need satisfaction variables have often been 
used to predict subjective well-being (SWB; Reis et al. 
2000; Sheldon /et al. 2011b; Sheldon and Elliot 1999; 
Sheldon et al. 2001) and thus we next compared the BPNS 
and BMPN. scales as»predictors of SWB. Which scale is 
more closely associated with this typical outcome? First, 
we regressed SWB upon the three BMPN need-satisfaction 
scales, assessed as observed variables. The R? for this 


Traits Methods 
Auto Comp Relate Sat Dis R e M SD 
Satisfaction items 
I was free to do things my own way .62 .04 .38 78 3.86 1.05 
My choices expressed my “true self” .66 21 48 T2 3.55 .96 
I was really doing what interests me. .66 36 S57 .66 3.30 1.09 
I was successfully completing difficult tasks* 46 53 49 71 3.69 1.07 
I took on and mastered hard challenges 38 78 ay 50 3.28 1.01 
I did well even at the hard things 48 64 64 .60 3.37 1.00 
I felt a sense of contact with people who care for me* .80 .07 .64 .60 4.09 1.01 
I felt close and connected with other people* .90 14 82 Al 3.98 .98 
I felt a strong sense of intimacy with people* 74 13 56 66 3.72 1.02 
Dissatisfaction items 
I had a lot of pressures I could do without. —.53 31 38 79 3.16 1.28 
There were people telling me what I had to do. —.50 36 38 79 2.54 1.20 
I had to do things against my will. —.54 .33 .40 78 2.10 1.09 
I experienced some kind of failure.* —.61 30 46 74 2.57 1.17 
I did something that made me feel incompetent* —.56 :32 Al 17 2.41 1.20 
I struggled doing something I should be good at —.66 .20 48 72 2.52 1.13 
I was lonely —.44 36 .32 .82 2.35 1.20 
I felt unappreciated by one or more important people —.43 .70 .68 .57 2.57 1.28 
I had disagreements or conflicts with people* =23 .68 .51 .70 2.46 1.33 


N = 324; Relatedness to competence (r = .51); Relatedness to autonomy (r = .59); Competence to autonomy (r = .54). Item-method loadings 
for “I was free to do things my own way” and “I felt a sense of contact with people who care for me” are not significant. * = item truncated due 


to length 
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analysis was .453 (p < .01), and autonomy, competence, 
and relatedness were each significant individually 
(Ps = .22, .38, and .24, respectively, p < .01 for each 
variable). Next, we regressed SWB upon the three BPNS 
need-satisfaction scales. The R7for this analysis was .444, 
about the same as the BMPN analysis. More importantly, 
the coefficient for BPNS relatedness satisfaction was non- 
significant ($ = .06, ns), although the coefficients for 
autonomy (f = .39) and competence (f = .30) were both 
significant (p < .01 for both). When all six predictors were 
included in the same equation, BPNS relatedness satis- 
faction remained non-significant (6 = .057, ns) in the 
analysis; the other five predictors were all significant (fs 
ranging from .11 t 0.25, all ps < .05). Thus, the BMPN can 
explain unique variance in SWB above and beyond the 
BPNS. 


Discussion 


The purpose of the current study was to generate evidence 
for the construct validity of the BPNS, a widely accepted 
domain general measure of needs satisfaction, and the 
BMPN, an alternative domain general measure of needs 
satisfaction offered here. Our analysis of post-secondary 
student responses to the two scales allowed us to explore 
the true dimensionality of the three SDT needs, an 
important next step in the study of need satisfaction mea- 
surement (Johnston and Finney 2010). Our analysis also 
allowed us to examine some of the documented problems 
with the BPNS, including issues with item wording and the 
dimensionality of the measure, opening up the opportunity. 
to offer an alternative scale to researchers with improved 
evidence for construct validity. 


Improved construct validity for the BMPN 


The BMPN demonstrated sound evidence of convergent and 
discriminant construct validity at the matrix level whereas 
responses to the BPNS again produced some problematic 
findings (Johnston and Finney 2010): The pattern that 
resulted from the model comparisons conducted on the 
BMPN data suggested that all three hypothesized trait fac- 
tors and both method factors were statistically important to 
the hypothesized model, providing evidence for convergent 
validity of both traits and methods. Analysis of the BMPN 
data also produced sound evidence of discriminant validity 
for the need satisfaction traits (i.e. comparison of model 1 to 
model 4), as well as evidence that the methods of mea- 
surement (i.e. item wording) did not bias measurement of the 
three need satisfaction variables (i.e. comparison of model 1 
to model 5). Taken together these results suggest the 
need satisfaction construct, as measured by the BMPN, is 
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comprised of three separate need factors measured via two 
methods—satisfaction and dissatisfaction items. These 
crucial findings did not hold true for the BPNS, where our 
analysis indicated that (1) responses to the BPNS did not 
differentiate adequately between one general need factor or 
three related but distinguishable need factors, and (2) the 
methods of measurement may bias the measurement of the 
need factors. 

Responses to the BPNS also did not meet rigorous cutoff 
criteria for model fit for any of the models we tested. Fit 
statistics for all BPNS models fell short of the rigorous fit 
requirements recommended in the CFA literature (Hu and 
Bentler 1999; Marsh et al. 2004). This was not the case for 
responses to the BMPN where, fit statistics for the models 
most consistent with the data exceeded rigorous cut values. 
These differences in fit, and related model comparisons, 
may explain some of the existing confusion in the literature 
regarding the dimensionality of the needs satisfaction 
construct (Deci/et al. 2001; Johnston and Finney 2010; 
Meyer et al. 2007; Niemiec et al. 2009). As explained in 
the literature-review, although some researchers argue for 
one general needs. satisfaction variable, others argue for 
three separate variables. Perhaps poor discriminant validity 
and method bias produced by responses to the BPNS has 
contributed to this confusion. 


Improved predictive power for the BMPN 


In order for any scientific theory to possess predictive 
power, it must first possess sound instruments that can be 
used to test predictions. In our analysis of the correlational 
relationship between responses to the BMPN, BPNS, and 
SWB, the BMPN accounted for a good amount of variance 
in the measure of SWB, and all three need satisfaction 
variables, as measured by the BMPN, were significantly 
and positively related to the outcome variable. These 
results are in line with existing published results. However, 
in the BPNS regression analysis, the scale accounted for 
less variance in SWB and relatedness need satisfaction did 
not have a significant unique effect, inconsistent with prior 
findings using different need-satisfaction measures (Reis 
et al. 2000; Sheldon and Elliot 1999; Filak and Sheldon 
2003). Perhaps the lower effect size and the non-significant 
relationship were due in part to the higher inter-correlations 
between the three BPNS subscales than the three BMPN 
subscales, noted in the preliminary results section. Here, 
the lack of discriminant validity for the BPNS may surface 
as a predictive problem that could result in incorrect 
interpretation of results and mixed support for SDT. This is 
a problem that, in the current study, is avoided in the 
BMPN data. 

Closer examination of the BMPN parameter estimates 
also produced important evidence for the convergent and 
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discriminant validity of the scale. Considering the com- 
plexity of the model and its overall excellent fit, the find- 
ings presented in Table 5 were relatively consistent with 
our expected outcomes. All trait loadings were statistically 
significant and adequate in magnitude, supporting conver- 
gent validity. All but two of the methods loadings were 
statistically significant and few exceeded the magnitude of 
their corresponding trait loading, indicating convergent 
validity. The correlations among the traits were theoreti- 
cally interpretable but were not so large in magnitude as to 
indicate collinearity, also supporting discriminant validity. 
Finally, evidence that the covariance between methods 
factors was not important to model fit indicated that the 
BMPN methods are maximally dissimilar, yet both mea- 
sure the traits effectively. 


Using the BMPN scale 


The results of the current study suggest that the BMPN 
scale could be used as three separate but distinguishable 
autonomy, competence, and relatedness subscales (after 
recoding the negatively worded items), as most researchers 
are likely to do. Additionally, the satisfactory reliabilities 
for the satisfaction and dissatisfaction forms of the three 
needs presented in the preliminary analysis suggest that the 
satisfaction and dissatisfaction subscales for a given need 
might be treated separately, thereby adding to the handful 
of studies that suggest satisfaction and dissatisfaction forms 
of the needs may be substantive and distinguishable in and 
of themselves (Bartholomew et al. 2011; Sheldon and Gunz 
2009; Sheldon et al. 2011b; Vlachopoulos and Michailidou 
2006). Instead of existing along a continuum, satisfaction 
and dissatisfaction may have unique effects that.can, be 
modeled and explored. The improved balance of the 
BMPN allows researchers to explore these effects confi- 
dently, as well as to explore more nuanced factor structures 
underlying the needs satisfaction construct. 


Limitations 


Limitations of this research include the fact that only a 
single study was conducted, of Midwestern US college 
students; thus, replicability ofthe results and generaliz- 
ability to other populations remains to be demonstrated. 
Also, although the sample size was reasonably large, the 
participants to variables ratio was only 5.6—1 for the most 
complex models, inducing potential concern about the 
stability of the parameter estimates for these models. 
Finally, other outcomes besides well-being need to be 
examined, to fully establish the predictive utility of the 
BMPN. Sheldon and Gunz (2009), Sheldon et al. (201 1a), 
and Sheldon and Schuler (2011) provided some such 
evidence. 


Final thoughts 


The results of the current study not only provide reasonable 
explanations for some of the measurement problems and 
omissions in the SDT literature, but also provide an alter- 
native measure that may help to untangle conflicting ideas 
about the structure of the need satisfaction construct. The 
alternative measure we provide which, in our sample of 
post-secondary students, has produced sound evidence of 
convergent and discriminant validity can be used in future 
research to continue to generate improved evidence for the 
structure of the need satisfaction construct and its invari- 
ance across various populations. Although the BPNS has 
yielded meaningful and significant-results in the literature, 
perhaps the BMPN can be used to,help to overcome some 
lingering inconsistencies and methodological difficulties in 
the study of need satisfaction. 


Appendix: The BMPN 
Relatedness 


1. J felt a sense of contact with people who care for me, 
and whom I care for. 

2. I was lonely. 

3. I felt close and connected with other people who are 
important to me. 

4. I felt unappreciated by one or more important people. 

5. I felt a strong sense of intimacy with the people I spent 
time with. 

6. I had disagreements or conflicts with people I usually 
get along with. 


Competence 


7. I was successfully completing difficult tasks and 
projects. 

8. Iexperienced some kind of failure, or was unable to do 
well at something. 

9. I took on and mastered hard challenges. 

10. I did something stupid, that made me feel 

incompetent. 
11. I did well even at the hard things. 
12. I struggled doing something I should be good at. 


Autonomy 


13. 13. I was free to do things my own way. 

14. 14. I had a lot of pressures I could do without. 

15. 15. My choices expressed my “true self.” 

16. 16. There were people telling me what I had to do. 
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17. 17. I was really doing what interests me. 
18. 18. I had to do things against my will. 


Administration 


Items should be alternated from the three subscales. Par- 
ticipants might rate their lives in general, their experience 
during some recent period of time, or their experience 
within some particular context or setting. Item wording 
may be modified slightly to fit (items above pertain to 
participants’ recent experiences). 


Scoring 


Satisfaction (odd items) and Satisfaction (even items) 
scores should be computed for each need (6 subscale scores 
in all). These may be examined separately, or, three 
aggregate need satisfaction scores can be computed by 
subtracting the dissatisfaction score for a particular need 
from the satisfaction score for that need. 
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